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NOVEL CURSOR CONTROL SYSTEM 

This application claims priority to provisional application number 60/200,81 7, 
filed April 27, 2000, entitled "Novel Cursor System" which is hereby incorporated by 
reference herein. 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates generally to interaction with televisions and more 
specifically to control of a cursor on a television utilizing a wireless remote control 
device. 

Description of the Related Art 

An electronic programming guide on a television can behave in many ways 
similar to applications on a personal computer. However, televisions do not have 
cursors and cursor control devices built in as do personal computers. Moreover, the 
typical user on a couch is not in a position to efficiently use a conventional mouse or 
trackball. One alternative currently in use is a tiny black ball, integrated as a trackball 
into an infrared remote control, but this arrangement can be hard to handle. Also, to 
untrained users, such a device may seem awkward because it lacks the intuitive nature 
of pointing to an object with the remote control. 

Another alternative in current use utilizes selection control arrow keys, which 
allow a selection highlight in a program to be moved in one of four directions depending 
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on which arrow key is pressed. Again, this lacks the intuitive nature of pointing to an 
object. Furthermore, objects on the screen may not simply be left, right, up or down 
from adjacent objects, leading to unexpected jumps in the selection highlight. 

Therefore, what may be advantageous is a remote control device that allows a 
user to point to an object on a television screen and then allows the user to choose the 
selected object on the television screen. 
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SUMMARY OF THE INVENTION 

A method and apparatus for a novel cursor control system is disclosed. In one 
embodiment, the invention is a method of manipulating a cursor on a tv screen utilizing 
a wireless remote control. The method includes detecting a location on the screen 
pointed to by the remote control. The method also includes Transmitting the location to 
a set-top box. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention is illustrated by way of example and not limitation in the 
accompanying figures. 

Figure 1 illustrates an embodiment of a system. 
5 Figure 2 illustrates an embodiment of an LCD screen. 

Figure 3 provides a flow diagram illustrating an embodiment of a process. 

Figure 4 provides a flow diagram illustrating an alternate embodiment of a 
process. 

Figure 5 provides a flow diagram illustrating another alternate embodiment of a 
|f process. 

S3 Figure 6 illustrates additional aspects of the embodiment of the system of Figure 

£ 1. 

f.rj Figure 7 provides a flow diagram illustrating yet another alternate embodiment of 

p a process. 

pj| Figure 8 illustrates an embodiment of a machine which may be used to 

C3 implement one or more components of a system. 
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DETAILED DESCRIPTION 

A method and apparatus for a novel cursor control system is described. In the 
following description, for purposes of explanation, numerous specific details are set 
forth in order to provide a thorough understanding of the invention. It will be apparent, 
5 however, to one skilled in the art that the invention can be practiced without these 
specific details. In other instances, structures and devices are shown in block diagram 
form in order to avoid obscuring the invention. 

Reference in the specification to "one embodiment" or "an embodiment" means 
that a particular feature, structure, or characteristic described in connection with the 
-4$ embodiment is included in at least one embodiment of the invention. The appearances 
W of the phrase "in one embodiment" in various places in the specification are not 
necessarily all referring to the same embodiment, nor are separate or alternative 
5" embodiments mutually exclusive of other embodiments. 

13 A method and apparatus for controlling a cursor using a wireless remote control 

fU> is described. This method and apparatus uses a detector in the remote control and a 
13 processor in a set-top box to determine what the remote control is pointing at, and the 
set-top box then processes this information to determine where or how to display a 
cursor on a tv screen or similar display. In one embodiment, a method or apparatus 
involves a tracking cursor on a screen which moves around as the user moves the 
20 remote control. An alternative embodiment employs a method or apparatus which 
includes a light source allowing a user to grab a cursor from its current location and 
move it to a desired location. Note that a wireless remote control may take any number 
of forms, using technology such as infrared, radio, modulated radio frequency, laser, for 
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example. Also, devices such as PDAs using software and possibly utilizing add-on 
hardware that collectively allow for remote control of a television system may be 
referred to as wireless remote control devices. 

Figure 1 illustrates an embodiment of a system. This includes screen 100, 
5 wireless remote control device 125, and set-top box 199. Screen 100 includes scan 
lines 101 , invisible horizontal retrace lines 102 and invisible vertical retrace lines 103. 
Symbolically, scan lines are numbered with number set 104. In one embodiment, on 
line 2 is object 110, that the user would like to choose using remote control 125. Line of 
sight 120 points to object 110. Sensor 121 in the remote control 125 can sense when 
l§ the scan of a tv electron beam (or similar scan on other display devices) touches the 
tQ area of object 110. Additionally, in some embodiments, sensor 121 can sense when 

the motion of remote control 125 causes the line of sight to cross a boundary in an LCD 
J" screen. Accordingly, the location of object 110 may be calculated by timing the scan 

relative to the Hsync and Vsync signals. However, as this is a wireless remote control, 
ij> there is no way to supply a pulse representing the scan of the screen at the targeted 
f 3 spot via a wired connection, as had been done in video games for example. 

Instead of using wires, the pulse is processed by microcontroller 123 and sent as 
infrared signal 130 by infrared transmitter 124 to set-top box 199. Set-top box 199 
receives the infrared signal in receiver 150 and then uses special controller 180, which 
20 may be implemented in either hardware, software, or some combination thereof, to 
compare the infrared signal 130 to video signal(s) 171 . Calculations based on this 
comparison provide a location 181 which is furnished to a processor 198 (or similar 
device) to position the cursor as would a normal cursor-positioning signal. Thus, the 
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system controller 198 (processor) can make the cursor visible by programming video 
chip 160, which may be a 2-D or 3-D video chip and which supplies video signals 170 to 
screen 100. 

In one embodiment, the tracking cursor moves around the screen in response to 
5 the movements of the remote control 125 as detected by the detector 121 (sensor) and 
processed by the remote control 125 and set-top box 199. In an alternative 
embodiment, light source 127, for example a laser LED or other light source, is included 
in the remote control 125. Light source 127 is aimed at semi-mirror 126 which is 
interposed in the line of sight beam 120 between an aperture in the remote control 125 
ftp housing and sensor 121 . Blinds 122a and 122b may be included to generate a narrow 
M focus for line of sight beam 120, resulting in greater accuracy both in picking up a signal 
j= and in sending a light spot. The light spot may be a red light as used in laser pointers 
JJl for example. The blinds 122a and 122b are focus elements, and may be implemented 
m with other devices, such as lenses for example. In other embodiments, conventional 
15 lens systems may be utilized to accomplish a function similar to that of the focus 
13 elements 122a and 122b, such as but not limited to plastic lenses and lens arrays for 
example. 

Figure 2 illustrates an embodiment of an LCD screen as an example of flat panel 
technology, which may also include but is not limited to plasma, EL, organic, FET, and 
20 other flat panel technologies for example. Those (flat panel) screens do not necessarily 
use the same scan process used in CRT screens, so other methods of calculating a 
position may be necessary. Large LCD screens and some other flat panel display 
technologies do have multiple sectors. In this exemplary illustration, LCD screen 200 is 
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illustrated with sector boundaries numbered 1-5 in the horizontal and vertical directions. 
In the numbering scheme illustrated, a sector may be addressed with a pair of 
coordinates, first a horizontal, then a vertical coordinate. Thus, sector 210 has 
coordinates 1,1. Similarly, sector 220 has coordinates 1 ,4, sector 230 has coordinates 
5 3,3 and sector 240 has coordinates 4,5. As illustrated, the coordinates correspond to 
the righthand and bottom boundaries of the sector. However, other numbering 
schemes and addressing schemes may be utilized to uniquely identify sectors on an 
LCD. It will be appreciated that other, similar approaches may be applied depending on 
actual screens connected. In some cases the user may have to go through a setup or 
Jf initialization routine to configure the system to the correct type of screen. 
15 With LCD screens and/or projector screens, the user may have to grab the 

;r cursor (such as with a light spot) and move the cursor, with transitions across sector 

boundaries detected to track motion for example. The implied track of motion may be 
13 displayed based on which sector boundaries are crossed. The processing involved in 
dLS such a system may be accomplished in controller 180 for example. As will be 
S3 appreciated, controller 180 may be a piece of software used with processor 198, 
specialized hardware, or some combination of the two. Furthermore, as will be 
appreciated, the infrared system including elements 124, 130 and 150 may alternatively 
be implemented as a wireless system using radio-frequency transmission or inductive 
20 transmission for example. 

Figure 3 provides a flow diagram illustrating an embodiment of a process. This 
process, in one embodiment, illustrates a process of utilizing a remote control device to 
operate a cursor on a tv screen. At block 31 0, the cursor and remote control device are 
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initialized with respect to the system. At block 320, the cursor is manipulated by the 
remote control device, such as moving the cursor or selecting an item pointed to by the 
cursor. At block 330, the cursor is displayed by the system in accordance with the 
manipulations actually detected by the system. Some manipulations, such as moving 
5 the cursor around in an area not corresponding to the screen may not be detected by 
the system, thus leading to no display of changes in the cursor. The manipulation and 
display portions of the process may be repeated, and, at times, the initialization process 
may be repeated. 

Figure 4 provides a flow diagram illustrating an alternate embodiment of a 
|§ process. In one embodiment, the process illustrated relates to the process of sensing 
IS and updating the cursor location. At block 410, the current location of the cursor is 

sensed, such as by the method described with respect to Figure 1 previously. At block 
fT, 420, the location of the cursor is transmitted to the controller, either as some form of 
13 explicit location, or as an indication of when a synchronizing signal was sensed. At 
If block 430, the display of the cursor is updated based on the location transmitted at 
id block 420. This process may be repeated as long as the system is active. 

Figure 5 provides a flow diagram illustrating another alternate embodiment of a 
process. At block 510, the cursor is grabbed, such as by having the remote control 
device pointed at the cursor (as illustrated by a light spot for example) and selecting the 
20 cursor for example. At block 520, the grab of the cursor is transmitted to the set-top 
box, thus informing it that the cursor is to be monitored. At block 530, the cursor is 
moved, such as by moving the remote control until it points at another portion of the 
screen. At block 540, the movement of the cursor is transmitted to the set-top box, thus 
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allowing for an update of the display of the cursor's position and potential detection of 
changes in what the cursor may select. This move and transmit portion of the process 
may be repeated and may occur over various time intervals, leading to either smooth 
motion of a cursor or jumps in the cursor's apparent location on the display. At block 
5 550, the cursor is released by the user, such as by explicitly releasing the cursor. At 
block 560, the release is transmitted to the set-top box, thus allowing it to stop 
monitoring the cursor movements. As will be appreciated, the release need not be 
explicit, it may be implicit in other processes within the remote control device or the set- 
top box. For example, selection of an entry on a display may trigger an automatic 

{tp release, as may expiration of a timer at a predetermined time after either a grab or a 
last move of the cursor. Such implicit releases may be detected or determined in the 

f: set-top box, eliminating the need for transmission, or may be detected or determined in 

J!;" the remote control device and transmitted to the set-top box. 

p Figure 6 illustrates additional aspects of the embodiment of the system of Figure 

fti> 1 . Initialization of the system may be important to properly tracking movement of the 
i!3 cursor, and may depend on various environmental and system variables. As a result, 
determination of delays or latencies in processor 123, transmitter 124 and receiver 150 
among other components (or paths such as line of sight 120 and transmission 130) in 
the embodiment of Figure 1 may be necessary. As illustrated, line of sight 120 is 
20 pointed at target 108A which is displayed on screen 100 along with targets 108B and 
1 08C. By pointing at the targets in a predetermined sequence or as instructed to by the 
system, the user may synchronize the system and allow for measurement of the delays 
in the system. Effectively, the system may be calibrated. Note that the number and 
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position of the targets is important only to the extent that they are known in advance for 
calculation purposes. Furthermore, correlation and calibration may be accomplished in 
a variety of ways, which may include other methods such as dynamically passing the 
remote control over a given part of the screen. Moreover, correlation may also involve 
5 selecting targets or releasing targets in systems utilizing such features. 

Figure 7 provides a flow diagram illustrating yet another alternate embodiment of 
a process. At block 710, a target is selected or pointed to. At block 720, the selection 
is transmitted, or alternatively the detected location is transmitted. At block 730, the 
transmission is correlated to known signals within a set-top box, resulting in a 

|f determination of expected delays between an action at the remote control device and 

10 receipt of a corresponding transmission at the set-top box. 

Figure 8 illustrates an embodiment of a machine which may be used to 

J" implement one or more components of a system. For example, the machine may 
implement the set-top box or the remote control with suitable changes or 

: ij5 enhancements. The machine 800 includes a processor 810, a memory 820 coupled to 

S3 the processor 81 0 and an interface 830 coupled to the processor 81 0. As will be 
appreciated, multiple processors 810, memories 820 and interfaces 830 may be 
included in a machine 800, and the processors 810, memories 820, and interfaces 830 
may be implemented in a variety of ways, such that a processor 810 may be 

20 implemented as a general processor, or as a video processor such as that described 
earlier with respect to Figure 1 . Moreover, it will be appreciated that a memory 820 may 
be expected to contain one or more of data or instructions suitable for use by the 
processor 810. Additionally, the processor 810, when executing instructions from the 
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memory 820, may be expected to perform a method associated with those instructions. 
Memory 820 may be implemented as one or more of a variety of media such as those 
described later in this description. 

Some portions of the detailed description are presented in terms of algorithms 
5 and symbolic representations of operations on data bits within a computer memory. 
These algorithmic descriptions and representations are the means used by those 
skilled in the art to most effectively convey the substance of their work to others skilled 
in the art. An algorithm as described here is generally conceived to be a self consistent 
sequence of acts or operations leading to a desired result. The acts are those requiring 
|f physical manipulations of physical quantities. Usually, though not necessarily, these 
C3 quantities take the form of electrical or magnetic signals capable of being stored, 
°£ transferred, combined, compared and otherwise manipulated. It has proven convenient 
^ at times principally for reasons of common usage to refer to these signals as bits, 
U values, elements, symbols, characters, terms, numbers, data or the like. 
Ill It should be borne in mind, however, that all of these in similar terms are to be 

O associated with the appropriate physical quantities and are merely convenient labels 
applied to these quantities. Unless specifically stated otherwise as apparent from the 
following discussion it is appreciated that throughout the description discussions 
utilizing terms such as "processing" or "computing" or "calculating" or "determining" or 
20 "displaying" or the like refer to the action and processes of a computer system or similar 
electronic computing device that manipulates and transforms data represented as 
physical (electronic) quantities within the computer systems registers and memories into 
other data similarly represented as physical quantities within the computer system 
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memories or registers or other such information storage transmission or display 
devices. The present invention can be implemented by an apparatus for performing the 
operations herein. This apparatus may be specially constructed for the required 
purposes or it may comprise a machine such as a general purpose computer selectively 
5 activated or reconfigured by a computer program stored in the computer. Such a 
computer program may be stored in a computer readable storage medium such as but 
not limited to any type of disk including floppy disks, optical disks, CD roms and 
magnetic optical disks, read only memories, random access memories, EPROMS, 
EEPROMS, magnetic or optical cards or any type of media suitable for storing 
If electronic constructions and each coupled to a computer system bus. Each of these 
Co media may be coupled to a computer system bus through use of an appropriate device 

for reading and or writing the media in question. Specialty apparatus may include a 
J|j collection of readily available pieces or an application specific integrated circuit 
i2 including a series of logic blocks for example. The blocks of Figures 7 or 8 may be 
l§ suitable for implementation as logic blocks, as may other configurations of the method, 
O system and apparatus described herein. 

The algorithms and displays presented herein are not inherently related to any 
particular computer or other apparatus. Various general purpose systems may be used 
with programs in accordance with the teachings herein or it may prove convenient to 
20 construct more specialized apparatus to perform the required method. For example, 
any of the methods according to the present invention can be implemented in hard 
wired circuitry by programming a general purpose processor or by any combination of 
hardware and software. One of skill in the art will immediately appreciate that the 
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invention can be practiced with computer system configuration. Configurations other 
than those described below including hand held devices, multi processor systems, 
microprocessor based or programmable consumer electronics, network PCs, mini 
computers, main frame computers and the like. The invention may also be practiced in 
5 distributed computing environments or tasks or performed by remote processing 

devices that are linked through a communications network. The required structure for a 
variety of these systems will appear from the description below. 

The methods of the invention may be implemented using computer software. If 
written in a programming language conforming to a recognized standard sequences of 
|§ instructions designed to implement the methods can be compiled for execution on a 
Co variety of hardware platforms or machines and for interface to a variety of operating 
systems. In addition the present invention is not described with reference to any 
particular programming language. It will be appreciated that a variety of programming 
j 3 ' languages may be used to implement the teachings of invention as described herein, 
if Furthermore, it is common in the art to speak of software in one form or another (for 
|3 example program procedure application etc..) as taken in action or causing a result. 
Such expressions are merely a shorthand way of saying that execution of the software 
by a computer causes the processor of the computer to perform an action or produce a 
result. 

20 In the foregoing detailed description, the method and apparatus of the present 

invention has been described with reference to specific exemplary embodiments 
thereof. It will, however, be evident that various modifications and changes may be 
made thereto without departing from the broader spirit and scope of the present 
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invention. In particular, the separate blocks of the various block diagrams represent 
functional blocks of methods or apparatuses and are not necessarily indicative of 
physical or logical separations or of an order of operation inherent in the spirit and 
scope of the present invention. For example, the various blocks of Figure 1 (for 
example) may be integrated into components, or may be subdivided into components. 
Similarly, the blocks of Figure 4 (for example) represent portions of a method which, in 
some embodiments, may be reordered or may be organized in parallel rather than in a 
linear or step-wise fashion. The present specification and figures are accordingly to be 
regarded as illustrative rather than restrictive. 
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